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VISUALIZATION SUPPLEMENTED WIRELESS MOBILE TELEPHONY - AUDIO 



RELATED APPLICATIONS 
The present application is a non-provisional application of provisional 
application number 60/418,765, filed October 15, 2002, having the same title. 

(a) The present application is also a continuation-in-part application of co- 
pending U.S. Patent Application number 10/086,954, filed March 1, 2002, 
entitled "Visualization Supplemented Wireless Mobile Telephony", which 
claims priority to provisional application 60/313,247, filed Aug 17, 2001. 
The '954 application is a continuation-in-part application of co-pending 
U.S. Patent Application number 09/767,587, filed January 22, 2001 , 
entitled "A Wireless Mobile Phone with Morse Code and Related 
Capabilities"; 

(b) co-pending U.S. Patent Application number 09/767,197, filed January 22, 

2001 , entitled "A Wireless Mobile Phone with Key Stroking Based Input 
Facilities"; 

(c) co-pending U.S. Patent Application number 10/087,098, filed March 1, 

2002, entitled "Method and Apparatus For Personalizing Mobile Electronic 
Devices Including Interchangeable Coverings with Embedded Personality" 
(which itself is a non-provisional application of provisional application 
number 60/306,326, filed on July 17, 2001, with the same title); and 
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(d) co-pending U.S. Patent Application number 09/908,118, filed July 17, 
2001, entitled "Method and Apparatus For Facilitating Luminescent 
Displays Utilizing A Wireless Mobile Phone". 
The specifications of these applications are herein fully incorporated by 
5 reference. 

FIELD OF PRESENT INVENTION 
The present invention relates to the field of wireless mobile telephony. More 
specifically, the present invention relates to visualization of various non-visual 
aspects of wireless mobile telephony to further improve the usability of wireless 
10 mobile phones. 

BACKGROUND OF THE PRESENT INVENTION 
Advances in integrated circuit and telecommunication technology have led to 
wide spread adoption of wireless mobile client devices, in particular, wireless mobile 
phones. Wireless mobile phones are popular, partly because they offer the 
15 advantage of enabling their users to be communicatively reachable by their business 
associates, friends and family members, wherever the users may be, as long as they 
are within the reach of the service networks. 

Ever since their initial introductions, the cost for owning and using a wireless 
mobile phone has steadily declined. Today, the cost for owning and using a wireless 
20 mobile phone is well within the ability of many non-professionals. In fact, as the cost 
for air time continues to decline, wireless mobile phones have become the first 
medium of communication for non-professionals as well as professionals. When the 
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need to make a call arises, a wireless mobile phone user will reach for their wireless 
mobile phone first, even if a traditional wired line telephone is readily available. 

At the same time, successive generations of wireless mobile phones have 
also packed more functions and performance while reducing in size. Today, virtually 
5 all wireless mobile phones offer core functions such as dial list, call log, and so forth, 
while many high end models offer advanced functions such as emails and Internet 
access. 

However, there remains a number of situations where the current generation 
of wireless mobile phones do not adequately address the users' needs and further 

1 0 improvements are needed. One of these situations is where audible operation of a 
wireless mobile phone is prohibited or inappropriate. In addition to theaters, many 
restaurants have joined the rank of commercial establishments requesting their 
patrons to turn off their wireless mobile phones to enhance the enjoyment of other 
patrons. In circumstances like these, under the prior art, a user would have to either 

15 turn off the wireless mobile phone, or go into a "silent" mode to be notified of an 
incoming call. For the former option, the user will no longer be able to receive an 
incoming call, and is communicatively disconnected from the user's colleagues and 
friends. As to the latter option, generally, it means placing the wireless mobile 
phone in a vibrational mode of operation. Under this mode, a wireless mobile phone 

20 appropriately equipped with the proper vibrational features would notify a user of an 
incoming call through activation of a vibration unit included with the wireless mobile 
phone. However, once notified, generally there is no convenient way for the user to 
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take and engage in the call. If the user desires to take the call, generally the user 
has to leave the environment that "imposed" the requirement. 

Another situation is in the area of content presentation. While as alluded to 
earlier, many high end models provide for Internet access, generally, for bandwidth 
5 and other reasons, the world wide web (WWW) contents are edited, with substantial 
amount of the multi-media contents removed. As a result, user experiences are 
generally less satisfying when compared to e.g. accessing the WWW using a 
personal computer. 

As those skilled in the art of wireless mobile telephony would appreciate, 
1 0 these are but a couple of examples of the limitations of the current generation of 
wireless mobile phones. One of the primary sensory abilities of a human being is 
the sensory of vision. Thus, as wireless mobile phones are increasingly becoming a 
personal accessory, it is desirable in general for wireless mobile phones to have 
greater abilities to visually present information or visually complement other 
1 5 conventional non-visual features. 

BRIEF DESCRIPTION OF DRAWINGS 
The present invention is illustrated by way of example and not by way of 
limitation in the figures of the accompanying drawings, in which like references 
indicate similar elements and in which: 
20 Figure 1 illustrates a functional view of the visualization feature of present 

invention for wireless mobile phones, in accordance with one embodiment; 

Figures 2a & 2b illustrate the relevant operational flows of the visualizer, 
including the relevant operational flows of the visualization controller and an 
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exemplary visualization agent, in accordance with one embodiment each, 
respectively; 

Figures 3a & 3b illustrate an external view of a wireless mobile phone, 
incorporated with the visualization teachings of the present invention, in accordance 
5 with one embodiment; 

Figures 4a & 4b illustrate an exposed view of a wireless mobile phone, 
incorporated with the visualization teachings of the present invention, in accordance 
with another embodiment; 

Figure 5 illustrates an internal component view of a wireless mobile phone, 
10 incorporated with the visualization teachings of the present invention, in accordance 
with one embodiment; 

Figure 6 illustrates an internal component view of an interchangeable portion 
of a wireless mobile phone, incorporated with the visualization teachings of the 
present invention, in accordance with one embodiment; 
15 Figures 7a & 7b illustrate exemplary visualizations of graphics and sounds, 

in accordance with one embodiment of the present invention; and 

Figures 8a & 8b illustrate exemplary visualizations of text and key stroking 
events, in accordance with one embodiment of the present invention. 
DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION 
20 Embodiments of the present invention provides for visualization of various non- 

visual aspects of wireless mobile telephony to further enhance the usability of wireless 
mobile phones. Among the various visualizations contemplated are visualization of 
telephony events, alphanumeric contents of messages and web pages, and sound. 
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Visualization of telephony events includes visualization of incoming call notifications 
and key stroking patterns (e.g. for menu selection). However, from the description to 
follow, it will be apparent that the visualization teachings of the present invention may 
also be applied and practiced with other non-visual aspects of wireless mobile 
5 telephony. 

Further, in the description to follow, for purposes of explanation, various details 
are set forth in order to facilitate a thorough understanding of the present invention. 
However, the present invention may be practiced without some or many of the 
specific details. In other instances, in order not to obscure the illustrated 

10 embodiments of the present invention, well-known features are omitted, simplified or 
merely briefly described. 

The description will be presented using terms that are commonly employed by 
those skilled in the art of wireless mobile telephony to convey the substance of their 
work to others skilled in the same art. Examples of these terms include but are not 

15 limited to incoming calls, detecting, determining, requesting, and so forth. As those 
skilled in the art of wireless mobile telephony would appreciate, these quantities may 
take the form of electrical, magnetic, or optical signals, and the operations involve 
corresponding processing of these signals by electrical, magnetic, or optical 
components. 

20 The term "wireless mobile phone" as used herein (in the specification and in 

the claims) refers to the class of telephone devices equipped to enable a user to 
make and receive calls wirelessly, notwithstanding the user's movement, as long as 
the user is within the communication reach of a "service or base station" of a wireless . 
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network service provider. Unless specifically excluded, the term "wireless mobile 
phone" is to include the analog subclass as well as the digital subclass (of all 
signaling protocols). 

Various operations will be described as multiple discrete steps in turn, in a 
5 manner that is most helpful in understanding the present invention. However, the 
order of description should not be construed as to imply that these operations are 
necessarily order dependent. In particular, these operations need not be performed 
in the order of presentation. 

The phrase "in one embodiment" will be repeatedly employed in the 

10 description to follow. In general, the phrase does not refer to the same embodiment, 
although in some instances it may. 

Referring now to Figure 1 , wherein a block diagram illustrating a functional 
view of the present invention, in accordance with one embodiment, is shown. As 
illustrated, in accordance with the present invention, wireless mobile phone 1100 is 

15 provided with a number of light emitting diodes (LEDs) 1114 and visualizer 1102. 
Further, visualizer 1 1 02 includes in particular visualizer controller 1112. For the 
illustrated embodiment, visualizer 1102 also includes a number of visualization 
agents 1104-1108. More specifically, visualization agents 1104-1108 include event 
visualization agent 1104, text visualization 1106, and sound visualization agent 

20 1108. 

LEDs 1114 are employed by visualizer 1102 to effectuate visualization of 
various non-visual aspects of wireless mobile telephony to enhance a user's 
experience in using wireless mobile phone 1100. More specifically, the desired 
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visualizations are effectuated by visualization controller 1112 selectively activating 
and de-activating selected ones of LEDs 1114 in selected manners, as requested by 
the requestors it serves. For the illustrated embodiments, these requestors include 
visualization agents 1104-1108. 
5 Beside LEDs 1114 and visualizer 1102, for the illustrated embodiment, 

wireless mobile phone 1100 also includes other hardware and software components 
1122-1124. Other hardware components 1122 include in particular a 
microprocessor for processing instructions, an input keypad for entering data and 
commands, a visual display for displaying information for the user, and a transceiver 

10 for sending and receiving signals wirelessly. Other software components 1124 
include in particular corresponding device drivers (e.g. for controlling the input 
keypad and the visual display), system services (e.g. graphics and audio services), a 
browser (e.g. for accessing the WWW), and various applications (e.g. dial list, call 
log, and so forth). Typically, at least selected ones of these system services, the 

1 5 browser and/or the applications include menus of commands for user selection. 

For the illustrated embodiment, other hardware and software components 
1122-1124 of wireless mobile phone 1100 include in particular the facilities 
necessary to practice the conduct of a non-audible call, using Morse codes. 
Conducting non-audible calls, in particular, through employment of Morse code, is 

20 the subject of incorporated by reference application '587. The required facilities are 
described in detail therein. Readers are directed to application '587 for details. 

For the illustrated embodiment, these other hardware and software 
components 1122-1124 of wireless mobile phone 1100 also include in particular the 
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facilities necessary to practice the selection of menu items by stroking or gliding over 
the input keys of the input keypad in various pre-determined stroking or gliding 
patterns. Data entry and/or menu item selection by way of key stroking or gliding 
patterns is the subject of incorporated by reference application '197. The required 
5 facilities are described in detail therein. Readers are likewise directed to application 
4 197 for details. 

Continuing to refer to Fig. 1 , the number of LEDs 1 1 1 4 to be employed as 
well as the manner in which they may be arranged are embodiment or configuration 
dependent. In one embodiment, a single column of LEDs 1114 disposed on a side 

10 surface of wireless mobile phone 1100 (as illustrated by Fig. 3a) is employed. In 
another embodiment, a collection of LEDs 1114 "integrally" arranged around or 
under the input keys of wireless mobile phone 1100 (as illustrated by Fig. 4a) is 
employed. In general, more variations, patterns and manners of visualization may 
be effectuated if more LEDs 1114 are employed. However, for each embodiment or 

15 configuration, the number of LEDs 1114 employable is constrained by cost, as well 
as by the spatial limitations imposed by the physical dimension and the number of 
other features included with the particular embodiment/configuration of wireless 
mobile phone 1100. 

LEDs 1114 are presently preferred for their relatively low power consumption 

20 and compactness in size. Together, these attributes allow a higher number of 

individually illuminable light sources to be employed. In turn, the higher number of 
illuminable sources allows more variations in the manner the illuminable light 
sources may be arranged and disposed. However, in alternate embodiments, other 
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light sourcing elements having attributes consistent with the design objectives and 
constraints may also be employed for the practice of the present invention. 
Accordingly, the term "LEDs" as used herein and in the claims are to be broadly 
construed, and given its conventional meaning as well as an expansive meaning 
5 including light sourcing elements with like attributes. 

As described earlier, visualization controller 1112 is employed to perform the 
earlier described selective activation and deactivation of selected ones of LEDs 
1114 in selected manners. The performances are made responsive to the requests 
of various visualization agents 1 104-1 108. For the illustrated embodiment, each of 
1 0 the various visualization agents 1 1 04-1 1 08 is responsible for invoking visualization 
controller 1112 to direct the activations and deactivations of LEDs 1114 to achieve 
the desired visualization for a corresponding non-visual aspect of wireless mobile 
telephony. 

More specifically, event visualization agent 1102 is responsible for invoking 
15 visualization controller 1112 to direct LEDs 1114 to effectuate visualization of 
various telephony events associated with wireless mobile telephony. For the 
illustrated embodiment, these telephony events include in particular the arrival of an 
incoming call, as well as the key stroking pattern for selecting a menu item (see Fig. 
8b, ref. 1804). 

20 Similarly, text visualization agent 1106 is responsible for invoking visualization 

controller 1112 to direct LEDs 1114 to effectuate visualization of various textual 
contents associated with wireless mobile telephony. For the illustrated embodiment, 
the textual contents include in particular textual contents of messages associated 
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with a non-audible call, conducted using Morse code (see e.g. Fig. 8a, ref. 1802), as 
well as textual contents of web pages (see e.g. Fig. 7a, ref. 1702). In other words, 
the present invention may be employed to enhance the user experience associated 
with operating in a "silent" mode, learning to use Morse code to conduct a non- 
5 audible call, or viewing multi-media content reduced web pages. Sound 

visualization agent 1108 is responsible for invoking visualization controller 1112 to 
direct LEDs 1114 to effectuate visualization of sounds associated with wireless 
mobile telephony and auxiliary functions (see e.g. Fig. 7b, ref. 1704). 

In various embodiments, the various sounds may include audio output of an 

10 included radio or an included MPx player or streaming audio (where MPx is one of 
the Moving Picture Expert Group audio standards, such as MP3, MP4 and so forth). 
In other words, the present invention may be employed to enhance the user 
experience associated with enjoying locally rendered or streamed audio. 

In other embodiments, the various sounds may include audio input picked up 

15 from the microphone. The audio may be "meaningful" ambient sounds. Examples 
of "meaningful" ambient sounds include but are not limited to music picked up from 
the ambient while the user of the wireless mobile phone is attending a concert with 
the phone, or crowd noise picked up from the ambient while the user of the wireless 
mobile phone is present in a sporting event with the phone. 

20 Concert may be concert of any music type, country western, rock 'n roll, pop, 

rap, jazz, classical, and so forth. Sporting event may be sporting event of any type, 
baseball, basketball, football, soccer, volleyball, swim meet, track, and so forth. 
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In various embodiments, the LEDs may be lit deterministically or pseudo 
randomly with at least one of the number of LEDs employed, the locations of LED 
employed, the color of the LEDs employed, and the intensity of the LEDs employed 
having a functional relationship to at least one attribute of the audio. 
5 Attributes of the audio include but are not limited to volume, frequency 

band/spectrum, treble, bass, presence of certain instruments, presence of certain 
notes, and so forth. 

In various embodiments, LEDs or groups of LEDs are correspondingly 
disposed underneath the input keys of the input keypad. Preferably, multiple color 
1 0 LEDs and/or multi-color LEDs are employed. 

For selected ones of these embodiments, a graphic equalizer is animated 
using the correspondingly disposed LEDs. In some embodiments, the different 
spectrums are animated on different columns of the LEDs, with the number of LEDs 
lit in each column corresponding to the volume of the audio in the corresponding 
1 5 spectrum, while in others, the different spectrums are animated on different rows of 
the LEDs, with the number of LEDs lit in each row corresponding to the volume of 
the audio in the corresponding spectrum. 

Further, in various embodiments, different colors are employed for different 
volume levels. For example, in a columnar embodiment, the color white is employed 
20 for the LEDs disposed with the first two rows of keys, the color yellow is employed 
for the LEDs disposed with the second two rows of keys, and the color red is 
employed for the LEDs disposed with the third two rows of keys. Of course, in 
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alternate embodiments, the present invention may be practiced with different colors, 
and different row grouping of LEDs. 

In other embodiments, in lieu of a graphic analyzer, a geometric primitive, a 
pattern, a thing, an object, a person or an animal may be animated instead. For 
5 example, a pattern or a geometric primitive, such as a spiral, a helix, or a vortex may 
be animated in accordance with one or more attributes of the audio. As a further 
example, an instrument, such as a guitar, a trumpet, a saxophone, a guitar, a drum, 
a pair of drumstick may be animated based on the presence of the instrument and/or 
attribute(s) of the audio (associated with the instrument). A ball, such as a baseball, 

10 a football, a basketball, a soccer ball, and a volleyball may be animated based on 
the volume of the ambient audio. Similarly, a mascot, such as a ram, a dolphin, a 
bronco, a lion, a tiger, a buffalo, a colt, a sea hawk, or a person, such as a pirate, a 
patriot, may also be animated based on the volume of the ambient noise. In yet 
other embodiments, the LEDs may be lit to animate "dance steps" based on selected 

1 5 attributes of the audio (music). Resultantly, a user of the wireless mobile phone may 
finger dance to the music, by tapping on the corresponding keys, following the 
animation. 

For the illustrated embodiment, visualizer controller 1112 advantageously 
offers at least two manners, a visualization agent may request a visualization 
20 operation or visualization operations to be performed. These two manners include a 
first manner where a singular round of activation and deactivation of LEDs 1114 may 
be requested, and a second manner where a number of rounds of activation and 
deactivation of LEDs 1114 may be simultaneously requested via a single request. 
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In one embodiment, the first manner is requested via a function call to 
visualization controller 1112, providing controller 1112 with the identifiers of LEDs 
1 1 14 to be activated, and the corresponding durations of activation. For this 
embodiment, all other unspecified LEDs 1114 are assumed to remain deactivated. 
5 In alternate embodiments, group specifications in particular, an "ALL" LED group 
may be advantageously supported. Additionally, in various embodiments, the 
intensity or brightest of each LED may be specified (e.g. by way of an 
intensity/brightness index in the range of 0 through 16). Further, for multi-colored 
LEDs, the color may be specified. 

10 In one embodiment, the second manner is requested via a function call to 

visualization controller 1112, providing controller 1112 with a pointer to a starting 
location in the included memory of wireless mobile phone 1100, where a data 
structure containing a series of rounds or cycles of activation and deactivation 
specifications is stored. The function call, in addition to the pointer, also includes a 

15 size of the data structure. In alternate embodiments, a predetermined end of 
structure demarcation may be employed, in lieu of a size specification. For each 
round/cycle of activation and deactivation, the LEDs to be turned on and off are 
identified. For example, for a row of eight LEDs, the LEDs to be turned on and off 
for a round or cycle may be specified by the "vector" [010101 1 1] with "0" denoting an 

20 "off' state and "1" denoting an "on" state. In alternate embodiments, other manners 
of specification as well as other manners of providing the specification may be 
employed instead. Further, as before, the intensity/brightness as well as color (in 
the case of multi-color LEDs) may be specified. 
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The above described approaches are just two exemplary approaches where a 
visualization agent may request visualization controller 1112 to selectively activate 
and deactivate LEDs 1114 on its behalf. Further, agents 1104-1108 are provided in 
the illustrated embodiment to facilitate the effectuation of the desired visualizations, 
5 such that the desired visualizations may be achieved without requiring or merely 
requiring relatively small amount of modifications to the main line logic or operational 
components of wireless mobile phone 1100. However, in embodiments where the 
earlier described "request" interface of visualization controller 1112 is practiced, the 
visualization services offered by visualization controller 1112 may also be directly 

10 invoked by the other components of wireless mobile phone 1100 instead, should 
direct incorporation of the required logic into these other components of wireless 
mobile phone 1100 to practice the present invention be desirable. Thus, generically, 
a visualization requestor, whether it is an "intervening" agent like visualization agents 
1104-1108 or a functional "principal" (such as the component responsible for 

15 incoming call notification), may be referred to as a visualization "client". 

Referring now to Figures 2a-2b, wherein the relevant operational flows of 
visualization controller 1112 and agents 1104-1108 for practicing the present 
invention, in accordance with two embodiments, are shown, respectively. As 
illustrated in Fig. 2a, upon receipt of a request to selectively activate or deactivate 

20 selected ones of LEDs 1114 in selected manners, block 1202, visualization 
controller 1112 determines if the request is of the first type (i.e. a single round 
request type), or of the second type (i.e. the multiple rounds/cycles request type), 
block 1204. The distinction of the two types may be explicitly specified or implicitly 
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inferred based at least in part on the format and/or substance of the calling 
parameters included with the function call. 

If the request is determined to be of the first type (i.e. a single round request 
type), visualization controller 1112 activates and/or deactivates selected ones of 
5 LEDs 1114 as requested, block 1208. If the request is determined to be of the 
second type (i.e. a multiple round/cycle request type), visualization controller 1112 
activates and/or deactivates selected ones of LEDs 1 114 as requested, block 1208, 
after retrieving the "specification" for the activations/deactivations to be performed, 
block 1206. For a multiple round request, the activation/deactivation operation of 

10 LEDs 1 1 1 4 of block 1 208 is iteratively performed for a sufficient number of times to 
achieve the selective activation/deactivation requested. 

Figure 2b illustrates the relevant operational flow of an exemplary 
visualization agent, which may be event, text or sound visualization agent 1104, 
1106, or 1108, in accordance with one embodiment. As illustrated, at initialization, 

1 5 the agent performs one of a number of possible actions to ensure it is availed with 
the relevant information and/or data associated with the non-visual aspect of 
wireless mobile telephony it is responsible for. These possible actions include but 
are not limited to registering itself with an appropriate source or system service, such 
that it will be notified of or provided with the relevant information and/or data, or 

20 performing the necessary set up or re-direct such that it will be availed the relevant 
information and/or data. 

For example, in an embodiment where the practiced visualizations include 
visualizing notice of an incoming call, at initialization, event visualization agent 1104 
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may register itself with a component of wireless mobile phone 1100 responsible for 
detecting an incoming call to notify it of such detection. Alternatively, event 
visualization 1104 may set itself up such that it can detect any attempt by the 
component to generate one or more rings for the incoming call. As those skilled in 
5 the art would appreciate, visualized notice of an incoming call is a particular useful 
alternative to the vibrational approach for a non-audible mode of operation, in lieu of 
the audible rings. Note that even for the non-audible mode of operation, the re- 
direct approach may nevertheless be effective if the component responsible for 
generating the audible rings will nevertheless make the attempts to generate the 

10 audible rings, and the attempts are merely "suppressed" (i.e. failed) or re-channeled 
to the component responsible for the vibrational notification, in view of the non- 
audible mode of operation. 

Another example is for text visualization agent 1 106 to register itself with or 
monitor the activities of the component responsible for rendering textual messages 

15 received in a non-audible call or the component responsible for rendering 
substantially textual (i.e. multi-media reduced) web pages. 

Yet another example is for sounds visualization agent 1108 to register itself 
with or monitor the activities of the component (e.g. a microphone, a browser, a 
radio, a MPx or other media player of phone 1 100) responsible for rendering audio 

20 contents or streaming audio. In one embodiment, the underlying system services 
include services for digitizing and providing digitized samples of audio. Upon 
registration with the service, sounds visualization agent 1108 receives the audio 
samples, and in response, determines the relevant attributes, such as volume, 
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spectrum, and so forth, accordingly. The number of attributes analyzed and/or 
characterized is application dependent. Characterization of audio by attributes, such 
as volume, spectrum, treble, bass, and so forth, is known, and accordingly, will not 
be further described. 

5 Continuing to refer to Fig. 2b, upon ensuring that it will be availed of the 

relevant information and/or data, the exemplary visualization agent awaits for 
provision or detection of the relevant information and/or data, block 1224. 
Thereafter, upon receipt of or detection of the relevant information and/or data, the 
exemplary visualization agent determines if the visualization condition or conditions 

10 for the non-visual aspect of wireless mobile telephony it is responsible for are 
present, block 1224. 

For example, in the case of event visualization agent 1104, it may consider 
the visualization condition is met upon having been notified by the component 
responsible for generating audible rings for incoming calls of the fact that an 

15 incoming call has been detected. In the case of text visualization agent 1106, it may 
consider the visualization condition being met upon detecting a textual message of a 
non-audio call being rendered, or upon detecting the browser rendering non- 
graphics or substantially textual contents. In the case of sounds visualization agent 
1108, it may consider the visualization condition as being met, upon detecting a 

20 radio, a MPx or other media player rendering sounds, or a microphone picking up 
"meaningful" ambient sounds. Placing the wireless mobile phone in an operation 
state within which ambient sounds are considered meaningful, may be assisted by 
the user, e.g. via user prompt/confirmation. 
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Upon determining that one or more visualization conditions are met, the 
exemplary visualization agent determines the appropriate visualization for the 
detected condition or conditions, block 1226. In various embodiments, the 
visualization to be effectuated under various visualization conditions are 
5 predetermined, and their exact nature are application dependent. 

For example, in the case of event visualization agent 1104, the predetermined 
visualization may involve requesting visualization controller 1112 to selectively 
activate and deactivate a row or column of LEDs 1 1 14 to alert the user of an 
incoming call, or activate selected ones of LEDs 1114 to visualize the key stroking 

10 pattern corresponding to a menu selection made. This latter visualization is 

especially useful in teaching or familiarizing a user in selecting menu options through 
key stroking pattern (see co-pending '197 application for further detail on menu 
selection through key stroking pattern). In the case of textual visualization agent 
1104, the predetermined visualization may involve requesting visualization controller 

15 1 1 12 to selectively activate and deactivate selected ones of LEDs 1 1 14 to echo the 
corresponding Morse code representations of the alphanumeric characters of a 
textual message being rendered for a non-audible call, or selectively activate and 
deactivate selected ones of LEDs 1114 to render certain predetermined graphics of 
interest to supplement the non-graphics contents of a web page being rendered. 

20 The former visualization is also particularly useful in teaching or familiarizing a user 
to conduct a non-audible call using Morse code (see co-pending '587 application for 
further detail on conducting a non-audible call using Morse code). The 
predetermined graphics for the latter visualization may be completely arbitrary or 
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dependent on the presence of certain key words in the non-graphics contents. In 
the case of sounds visualization agent 1108, the predetermined visualization may 
involve requesting visualization controller 1112 to selectively activate and deactivate 
selected ones of LEDs 1114 to render certain illumination patterns corresponding to 
5 certain predetermined attributes of the sound being rendered (e.g. its beat, tempo 
and so forth). The illumination to be rendered corresponding to the various 
attributes may be specified or stored in e.g. one or more audio visualization files. 
These specification files may be pre-provided, dynamically downloaded from a 
server, or retrieved from a storage medium integrated with an interchangeable 

10 covering of the mobile phone (also referred as "active" skin for certain embodiments, 
see the above identified co-pending application '098 for further detail). The various 
attributes may be determined e.g. from samples derived from the audio stream of 
the integrated radio or MPx player. The sampling may be performed continuously. 
In other words, for such continuous sampling embodiment, attributes are determined 

15 periodically based on the obtained samples, and the illumination pattern is selected 
based on the determined attributes. This process of attribute determination and 
illumination pattern selection is repeatedly performed, e.g. for as long as sounds are 
being rendered (or until instructed by a user to terminate). 

Upon determining the visualization, the exemplary visualization agent 

20 requests visualization controller 1 1 12 to effectuate the desired visualization 

accordingly, block 1228. Thereafter, the exemplary visualization agent returns to 
block 1224, and continues from there as described earlier, until eventually operation 
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of the exemplary visualization agent is terminated (for whatever reason, e.g. when 
phone 1100 shuts down). 

Note that while the foregoing description suggests that event, text and sound 
visualization agents 1104-1108 may operate with substantially the same operational 
5 flow, in alternate embodiments, each or selected ones of visualization agents 1104- 
1108 may operate with substantially different operational flow instead. Further, the 
present invention may be practiced with more or less visualization agents. 
Regardless of the number of visualization agents provided, preferably, user selection 
facility is provided to enable a user to selectively and individually enable or disable 

1 0 each of the provided visualization agents. 

Having now described the present invention from a function view, in 
particular, the various relevant operational flows, we turn now to describe various 
exemplary embodiments for disposing and configuring the various elements for 
practicing the visualizations of the present invention. Figures 3a - 3b illustrate an 

1 5 external view of a wireless mobile phone 1 100a, incorporated with the visualization 
teachings of the present invention, in accordance with one embodiment. More 
specifically, Fig. 3a illustrates a side view of wireless mobile phone 1100a, whereas 
Fig. 3b illustrates a front view of wireless mobile phone 1100a. 

For the illustrated embodiment, as alluded to earlier, wireless mobile phone 

20 1100a includes antenna 1320, speaker 1322, visual display 1324, input key pad 
1326 having input keys 1328, microphone 1330, and so forth. More importantly, 
wireless mobile phone 1100a includes LEDs 1114a disposed on a side exterior 
surface of the body of wireless mobile phone 1100a. In one implementation, 
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wireless mobile phone 1100a further includes a radio (not shown). In another, 
wireless mobile phone 1100a further includes a MPx player (not shown). 

In alternate embodiments, LEDs 1114a may be disposed in other exterior 
surfaces of the body of the wireless mobile phone 1 100a instead. These other 
5 exterior surfaces may include the top or bottom exterior surface, and the front or 
back exterior surface. Note that by virtue of the manner content is displayed in 
visual display 1324, the exterior surfaces corresponding to the top, bottom, side, 
front and bottom surface are definitively defined. 

For the illustrated embodiment, LEDs 1114a are disposed on the side exterior 

10 surface in a substantially columnar manner, along imaginary longitudinal axis 1311. 
In alternate embodiments, LEDs 1114a may be arranged in other configurations, 
e.g. in multiples of even or uneven rows and/or columns. 

In one embodiment, LEDs 1114a are single ed LEDs of the same color. In 
another embodiment, LEDs 1114a are single colored LEDs of different colors. In 

1 5 yet another embodiment, every three single colored LEDs of different colors (e.g. 
one Red, one Green, and one Blue) are grouped and proximately disposed together 
(e.g. each input key having one corresponding group of LEDs around it), functionally 
forming multiple 3-LED groups to facilitate manifestation of other non-basic colors, 
such as orange, yellow and so forth. In yet another embodiment, at least some of 

20 LEDs 1114a are multi-colored LEDs. A multi-colored LED is a LED that is capable 
of emitting light in a selected one of a plurality of colors. Figures 4a-4b illustrate an 
exposed view of wireless mobile phone 1100b, in accordance with an alternate 
embodiment. More specifically, Fig. 4a illustrates an exposed front view of wireless 
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mobile phone 1100b with its front cover 1421 removed, whereas Fig. 4b illustrates 
an exposed interior (or backside) view of front cover 1421 . Front cover 1421 is also 
referred to as an interchangeable face plate. 

Similar to the embodiments of Figs. 3a-3b, wireless mobile phone 1100b 
5 includes speaker 1422, visual display 1424, input keys 1428, microphone 1430, and 
so forth. In one implementation, wireless mobile phone 1 100b further includes a 
radio (not shown). Correspondingly, front cover (face plate) 1421 has "opening" 
1423 for speaker 1422, "opening" 1425 for visual display 1424, "opening" 1427 for 
input keys 1428, "opening" 1429 for microphone 1430, and so forth. 

10 More importantly, wireless mobile phone 1100b includes LEDs 1114b 

disposed on the interior front surface of wireless mobile phone 1100b, near or 
around input keys 1428. With front cover (face plate) 1421 in place, LEDs 1114b 
appear to be integrally disposed with input keys 1428. In other words, for the 
illustrated embodiment, LEDs 1114b are disposed and configured as an array of 

15 light sources. In one implementation, front cover (face plate) 1421 further includes 
an electronic component (not shown) having stored therein, programming 
instructions implementing a MPx player. 

Similar to the variants of the embodiment of Fig. 3a-3b, LEDs 1114b may be 
single colored LEDs of the same color, or single colored LEDs of different colors. 

20 Further, in some embodiments, every three different color single colored LED, such 
as one Red, one Green and one Blue, may be grouped and proximately disposed 
together (e.g. each input key having one corresponding group of LEDs around it) to 
form groups of LEDs as earlier described. In yet other embodiments, at least some 
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of LEDs 1114b may be multi-colored LEDs (where a selected one of a plurality of 
colors may be lit). 

As will be described in more detail below, front cover (face plate) 1421 may 
be an "active" front cover/face plate having an electronic component wherein all or 
5 portions of the visualization teachings of the present invention are implemented. In 
particular, in various embodiments, "active" front cover (face plate) 1421 is an 
"active" covering "skin" covering all or a portion of the body of wireless mobile phone 
1100b. For these embodiments, instead of being disposed and configured on the 
interior front surface of wireless mobile phone 1100b, LEDs 1114b may be disposed 

1 0 on the exterior surface of the "active" interchangeable front cover (face plate) or 
covering "skin" instead. Active front cover (face plate) or covering "skin" is the 
subject matter of incorporated by reference application 'zzz. The constituting 
elements of these active front cover (face plate) or covering "skin" are described in 
details therein. Readers are referred to application 'zzz for details. 

15 FIGURE 5 illustrates an internal component view of wireless mobile phone 

1100, in accordance with one embodiment. As illustrated, wireless mobile phone 
1100 includes the earlier mentioned microprocessor 1503, transmitter/receiver 
(TX/RX) 1513 (also known as transceiver), and so forth, coupled to each other as 
shown. Additionally, for the illustrated embodiment, wireless mobile phone 1100 

20 further includes digital signal processor (DSP) 1502, communication interface 1511, 
and general-purpose input/output (GPIO) 1515, coupled to each other and to the 
earlier described elements as shown. Most importantly, wireless mobile phone 1100 
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includes LEDs 1114 and non-volatile memory 1510 having visualizer 1102a stored 
therein. 

In addition to the conventional functions performed by these elements, the 
elements are employed to practice the visualization teachings of the present 
5 invention earlier described. In particular, among the conventional functions, it is 
expected that TX/RX 1513 may support one or more signaling protocols, including, 
but not limited to, code division multiple access (CDMA), time division multiple 
access (TDMA), global system for mobile communications (GSM), cellular digital 
packet data (CDPD), and so forth. Similarly, communication interface 1511 may 
10 support one or more serial, parallel and/or wireless communication protocols. 

In alternate embodiments, other elements may be added, as well as having 
one or more of the illustrated elements omitted, without departing from the spirit and 
scope of the present invention. 

Figure 6 illustrates an internal component view of an "active" version of 
15 interchangeable "cover" 1421, in accordance with one embodiment. As illustrated, 
"active" interchangeable "cover" 1421 includes in particular, electronic component 
1620. For the illustrated embodiment, interchangeable "cover" 1421 also includes 
LEDs 1114 (disposed and configured on an exterior surface). 

In various embodiments, interchangeable "cover" 1421 may be a "housing 
20 cover", i.e. being a part of a housing of the wireless mobile phone. In other 

embodiments, interchangeable "cover" 1421 may be an "accessory cover", i.e. the 
"cover" is merely "adorned by the wireless mobile phone, and does not form a part of 
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a housing of the wireless mobile phone. Thus, term "cover", unless particularized, 
shall include "housing" as well as "accessory" covers. 

In one embodiment, electronic component 1620 is a memory device, e.g. a 
subscriber identity module (SIM). In alternate embodiments, it may be a 
5 microprocessor having embedded memory. More importantly, for these 

embodiments, at least one or more of the visualization agents 1104-1108 are stored 
in the embedded memory. In various embodiments, the entire visualizer 1102, 
including visualization controller 1112, as well as agents 1104-1108 are stored in the 
embedded memory. In other words, for these embodiments, the visualization ability 

10 is additionally provided or partially provided to wireless mobile phone 1100 through 
the employment of an "active" interchangeable "cover" 1421 (i.e. face plate or 
covering skin), having embedded electronic component 1620 including all or a 
portion of visualizer 1 102b. 

Thus, it can be seen from the above description, methods and apparatuses 

1 5 for supplementing wireless mobile telephony with visualization of various non-visual 
aspects of wireless mobile telephony to improve usability have been described. As 
mentioned earlier, while the present invention has been described in terms of the 
above-illustrated embodiments, the present invention is not limited to the 
embodiments described. The present invention can be practiced with modification 

20 and alternation within the spirit and scope of the appended claims. For example, in 
various embodiments, visualization of events may include visualization of an "idle" 
state. That is, upon detection of an "idle" state, a predetermined pattern of activation 
and deactivation of the LEDs may be effectuated. The predetermined pattern may 
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correspond to a theme, e.g. a Christmas theme, an American theme, and the like. 
The predetermined pattern may be pre-provided, downloaded or retrieved from the 
integrated electronic component of an interchangeable cover plate ("active" skin). 
Thus, the description is to be regarded as illustrative instead of restrictive on the 
5 present invention. 
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